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Executive  Summary 

Purpose 

Each  year,  the  Army,  Air  Force,  and  Navy  spend  milhons  of  doUars  to 
operate  prep  schools  to  prepare  students  for  admission  to  the  service 
academies.  In  its  report  on  the  fiscal  year  1991  National  Defense 
Authorization  Act,  the  House  Armed  Services  Committee  noted  that  the  size 
of  the  officer  corps,  and  of  the  academies,  would  dechne  in  future  years 
and  asked  GAO  to  review  the  prep  schools.  GAO  objectives  were  to  assess 
(1)  how  weU  the  schools  accomphshed  their  missions  and  (2)  whether  they 
were  cost-effective. 

Background 

Between  1986  and  1990,  the  three  academies  combined  received  an 
average  of  41 ,834  apphcations  a  year.  Each  year,  on  average,  8,562 
appUcants  were  judged  to  be  fully  quaUfied  candidates.  The  academies, 
however,  admitted  an  average  of  only  4,072  cadets  and  midshipmen. 
Academy  officials  screen  the  applicants  who  are  not  offered  appointments 
to  identify  persons  who  have  the  potential  to  succeed  in  the  officer  corps 
but  would  benefit  from  additional  preparation.  Some  of  these  unsuccessful 
apphcants  are  offered  admission  to  the  service’s  prep  school,  providing  a 
second  chance  to  compete  for  a  service  academy  appointment. 

The  schools,  which  are  tuition-free  and  provide  pay  and  allowances  to 
students,  offer  academic  instruction,  physical  conditioning,  and  an 
orientation  to  military  life.  In  1990,  the  Army  prep  school  enrolled  303 
students,  the  Air  Force  prep  school  enrolled  256  students,  and  the  Navy 
prep  school  enrolled  346  students,  including  36  students  who  were 
preparing  for  admission  to  the  Coast  Guard  Academy. 

RGSUltS  in  Brief  schools’  missions  are  not  clearly  defined.  Their  mission  statements 

refer  to  preparing  “selected”  individuals  for  academy  admission.  The 
schools  appear  to  be  pursuing  differing  goals  regarding  specific  subgroups 
such  as  enlisted  personnel,  females,  minorities,  and  recruited  athletes— the 
primary  groups  the  schools  now  serve.  For  example,  about  50  percent  of 
the  students  enrolled  at  the  Air  Force  prep  school  were  recruited  athletes; 
this  is  about  double  the  percentage  of  recruited  athletes  at  the  Army  and 
Navy  schools. 

The  Department  of  Defense  (DOD)  has  hmited  information  on  the  quahty  of 
the  schools’  programs.  Program  reviews  of  the  prep  schools  conducted  by 
service  academy  faculty  do  not  assess  the  schools  against  a  uniform  set  of 
quahty  and  performance  standards.  DOD  lacks  the  tools  and  information  it 
needs  to  assess  whether  the  schools  are  cost-effective.  GAO’s  review 
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indicated  that  the  Navy,  Army,  and  Air  Force  preparatory  programs  cost 
about  $39,800,  $50,900,  and  $60,900,  respectively,  for  each  student 
entering  an  academy. 


Principal  Findings 


Schools  Serve  Varied 
Missions  and  Receive 
Inadequate  Oversight 


Initially,  the  schools  were  established  to  help  prepare  enlisted  personnel 
for  admission  to  the  academies.  Over  the  years,  however,  the  schools’ 
missions  have  evolved  and  become  more  diverse.  Academy  officials  told  us 
that  the  prep  schools  were  currently  important  because  they  prepare 
minorities  and  women  for  academy  admission  and  therefore  promote 
diversity  in  the  officer  corps.  In  addition,  each  school  helps  prepare  some 
athletes  to  attend  the  academies. 

The  specific  subgroups  served  varied  from  school  to  school.*  The  Army’s 
school  places  the  strongest  emphasis  on  preparing  enlisted  personnel,  who 
represented  about  55  percent  of  enrollment  in  the  school’s  1988-89  and 
1989-90  classes,  compared  to  12  percent  at  the  Air  Force  school  and 
21  percent  at  the  Navy  school.  Females  represented  about  10  percent  of 
the  enrollment  at  each  school.  The  Air  Force  and  Navy  schools  enrolled  a 
higher  proportion  of  minority  students— about  40  percent— than  the  Army 
school— about  22  percent.  Preparing  recruited  athletes  appears  to  have 
been  a  key  objective  of  the  Air  Force  school,  where  athletes  represented 
about  50  percent  of  the  enrollment.  Athletes  represented  about  24  percent 
and  27  percent  of  the  enrollment  at  the  Army  and  Navy  schools. 

The  service  academies  schedule  periodic  program  reviews  of  the  schools, 
which  are  generally  conducted  by  members  of  the  academy  faculty.  The 
schools  have  not  sought  accreditation  and  their  cmriculums  and  academic 
programs  have  not  been  assessed  against  a  imiform  set  of  quality 
standards.  The  experience  of  faculty  at  the  schools  varied  substantially, 
averaging  about  4  years  of  teaching  experience  at  the  Air  Force  school, 
about  8  years  at  the  Navy  school,  and  over  15  years  at  the  Army  school. 


'since  the  population  subgroup  categories  are  not  mutually  exclusive,  the  percentages  cited  for  each 
prep  school  will  sum  to  more  than  100  percent. 
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DOD  Has  Not  Assessed  the 
Productivity  or  Cost  of  the 
Schools 


Recommendations 


In  1990,  about  14  percent  of  the  cadets  and  midshipmen  admitted  to  the 
three  services’  academies  had  attended  one  of  these  schools.  The  schools 
achieved  varying  degrees  of  success  in  placing  students  in  the  service 
academies.  The  percentage  of  prep  school  students  in  the  1988-89  and 
1989-90  classes  receiving  em  academy  appointment  was  about  54  percent 
of  students  enrolled  at  the  Army  school,  71  percent  at  the  Navy  school,  and 
73  percent  at  the  Air  Force  school.  The  performance  of  prep  school 
students  at  the  academies  wais  generally  below  the  average  of  other 
academy  cadets  and  midshipmen.  Graduation  rates  varied  from  about 
65  percent  of  the  prep  school  students  enrolled  in  the  classes  of  1986 
through  1990  at  the  Air  Force  Academy  and  69  percent  at  the  Military 
Academy  (both  somewhat  lower  than  other  cadets)  to  about  78  percent  at 
the  Naval  Academy  (somewhat  greater  than  other  midshipmen).  Each 
service  expressed  satisfaction  with  the  appointment  and  graduation  rate 
experience  of  its  school,  but  neither  DOD  nor  the  services  have  estabUshed 
performance  targets  for  the  schools.  Moreover,  a  1985  Army  study 
concluded  that  the  effect  of  prep  school  academic  training  on  subsequent 
academic  performance  at  the  MiUtary  Academy  was  minimal. 

DOD  does  not  require  the  schools  to  regularly  report  their  operating  costs. 
DOD  has  not  provided  instructions  on  how  to  estimate  costs  and  the  bases 
for  cost  estimates  were  not  consistent  across  schools.  GAO  identified  about 
$2.9  milhon  in  additional  annual  appUcable  costs  that  should  have  been 
included  in  the  $24.9  million  cost  estimates  the  services  provided  to  GAO. 

Based  on  data  supplied  by  the  schools,  GAO  estimates  the  Army,  Air  Force, 
and  Navy  preparatory  programs  cost  about  $60,900,  $50,900,  and 
$39,800,  respectively,  for  each  student  who  entered  an  academy.  These 
costs  are  almost  as  much  or  more  than  the  cost  of  sending  someone  to  the 
corresponding  academy  for  a  year  and  are  2.5  to  4  times  as  much  as  the 
cost  to  send  a  student  to  a  highly  selective  college  for  a  year. 


GAO  recommends  that  the  Secretary  of  Defense  determine  what  role  the 
prep  schools  should  play  among  the  services’  officer  production  programs 
and  direct  the  services  to  clarify  the  missions  of  their  schools  accordingly. 
GAO  also  recommends  that  the  Secretary  establish  appropriate  standards 
appUcable  to  the  schools’  faculty  and  curriculums  and  require  periodic 
independent  reviews  to  ensure  that  the  schools  meet  these  standards. 

To  ensure  that  the  resources  devoted  to  the  prep  schools  are  used 
efficiently,  GAO  recommends  that  the  Secretary  estabUsh  guidelines  for 
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estimating  school  costs.  Once  performance  standards  and  cost  estimating 
guidelines  are  in  place,  GAO  recommends  that  the  Secretary  require 
periodic  assessments  of  the  cost-effectiveness  of  continuing  to  operate  the 
schools.  Given  the  relatively  high  cost  per  cadet/midshipman  placed  at  an 
academy,  consideration  should  be  given  to  alternative  methods  of 
providing  academy  preparation,  such  as  utihzing  existing  educational 
institutions  or  the  private  sector. 


Agency  Comments 


DOD  reviewed  a  draft  of  this  report  and  concurred  with  the  principal 
findings  and  recommendations.  As  part  of  increased  oversight  of  officer 
accession  programs,  DOD  stated  that  it  has  initiated  several  actions  to 
improve  cost  reporting,  efficiency,  management,  and  supervision  of  the 
prep  schools,  and  indicated  it  would  thoroughly  examine  the  full  range  of 
measures  to  improve  the  operation  of  the  schools. 
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Introduction 


Background 


Academies  operated  by  the  Army,  Air  Force,  and  Navy  are  one  of  the 
primary  sources  of  newly  commissioned  officers.  To  enter  the  academies, 
apphcants  who  meet  basic  criteria  of  age,  medical  condition,  and  physical 
aptitude  are  evaluated  using  a  formula  that  weighs  the  apphcant’s 
academic  record,  scores  on  standardized  tests,  and  potential  for 
leadership.  Between  1986  and  1990,  the  three  service  academies  combined 
received  an  average  of  41,834  applications  a  year  and  found  an  average  of 
8,562  apphcants  to  be  qualified  for  admission.  The  academies  admitted  an 
average  of  4,072  cadets  and  midshipmen  a  year  dming  this  period. 


The  Service  Academy  Prep  The  preparatory  schools  were  originally  created  to  prepare  enlisted 
Schools  personnel  to  enter  the  service  academies.  During  World  War  I,  the 

Congress  authorized  the  Secretaries  of  the  Army  and  Navy  to  nominate  85 
regular  enUsted  and  85  reserve  enlisted  personnel  to  their  respective 
service  academies.  Many  of  the  first  enhsted  nominees  did  poorly  on 
service  academy  entrance  examinations,  and  many  of  the  slots  created  for 
them  went  imfiUed.  While  not  created  through  legislation.  Army  and  Navy 
officials  established  prep  schools  to  coach  enUsted  nominees  for  service 
academy  entrance  examinations. 

If  an  apphcant  is  not  selected  for  admission  to  an  academy,  service  prep 
schools  can  provide  them  a  second  chance  at  a  service  academy 
appointment.  Although  Army  and  Air  Force  enUsted  personnel  may  either 
apply  for  admission  to  the  academy  or  the  prep  school,  individual  civiUans 
normaUy  do  not  apply  to  attend  a  prep  school.  Instead,  students  are 
selected  to  attend  the  prep  schools  from  the  pool  of  service  academy 
apphcants  who  do  not  receive  an  appointment.  Academy  admissions 
officials  screen  these  appUcants  to  identify  persons  who  they  believe  can 
succeed  at  the  academies  but  would  benefit  from  more  preparation. 
Academy  officials  stressed  that  written  criteria  for  prep  school  selection  do 
not  exist;  considerable  personal  judgment  of  admissions  officials  is 
involved. 

The  prep  schools  do  not  charge  for  tuition.  The  services  reassign  personnel 
already  enUsted  in  the  service  to  the  school  as  their  duty  station,  and  they 
continue  to  be  paid  at  the  grade  they  earned  before  enrolling.  CiviUans 
enUst  in  the  reserves  and  are  ordered  to  active  duty  at  the  school,  generaUy 
entermg  the  school  at  the  lowest  enUsted  pay  grade.  By  enUsting  in  the 
reserves,  civiUans  technicaUy  incur  a  service  obUgation.  This  obUgation, 
however,  is  generaUy  waived  for  civiUans  who  do  not  complete  the  prep 
school  course  of  study  or  who  do  not  receive  an  academy  appointment. 
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Students  are  eligible  to  be  considered  for  promotion  within  the  same  time 
frame  as  other  enUsted  personnel. 

Course  of  Study 

The  prep  schools  offer  a  10-month  course  that  combines  academic 
instruction,  physical  conditioning,  and  an  orientation  to  mihtary  Ufe.  The 
daily  schedule  includes  about  4  to  5  hours  of  classroom  instruction,  about 

3  to  4  hours  of  mandatory  study  time  and  tutoring,  a  period  of  athletics  or 
physical  training,  and  some  instruction  in  mihtary  customs  and  practices. 
The  student  body  at  each  school  is  organized  into  a  mihtary  unit  with  a 
student  chain-of-command  advised  by  commissioned  and 
noncommissioned  officers.  This  structure  is  intended  to  provide  the 
students  exposure  to  mihtary  discipline  and  operations. 

Numbers  of  Students 

In  1990,  the  Army  prep  school  enrolled  303  students  and  the  Air  Force 
school  enrolled  256.  The  Navy  school  enrobed  310  students  preparing  for 
the  Naval  Academy  and  36  preparing  for  the  U.S.  Coast  Guard  Academy.  In 
1991,  the  Navy  school  also  began  enrolling  students  preparing  for 
admission  to  the  U.S.  Merchant  Marine  Academy.*  Of  the  3,963  cadets  and 
midshipmen  that  entered  the  Army,  Air  Force,  and  Navy  academies  in 

1990,  about  14  percent  had  attended  1  of  the  3  prep  schools. 

Objectives,  Scope,  and 
Methodology 

In  its  report  on  the  fiscal  year  1991  National  Defense  Authorization  Act,  the 
House  Armed  Services  Committee  noted  that  the  services  were  entering  an 
era  in  which  the  size  of  the  force,  and  of  the  officer  corps  in  particular, 
would  be  shrinking.  Since  the  prep  schools  are  one  program  that  trains 
future  officers,  the  Committee  directed  us  to  review  the  three  service 
academy  prep  schools  to  assess  (1)  how  weh  the  schools  accomplished 
their  missions  and  (2)  whether  they  were  cost-effective. 

We  performed  our  review  at  the  Department  of  Defense  (DOD)  and  service 
headquarters,  Washington,  D.C.;  at  the  Mihtary  Academy  in  West  Point, 
New  York;  the  Air  Force  Academy  in  Colorado  Springs,  Colorado;  the 

Naval  Academy  in  Annapolis,  Maryland;  the  Mihtary  Academy  Preparatory 
School  in  Fort  Monmouth,  New  Jersey;  the  Air  Force  Academy  Preparatory 
School  in  Colorado  Springs,  Colorado;  and  the  Naval  Academy  Preparatory 
School  in  Newport,  Rhode  Island. 

^The  Merchant  Marine  Academy  is  operated  under  the  Department  of  Transportation  and  does  not  have 
its  own  prep  school. 
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We  interviewed  DOD,  service  headquarters,  and  academy  officials  to 
determine  what  missions  the  schools  were  intended  to  pursue  and  to  obtain 
their  assessment  of  the  schools’  accompUshments  and  the  quaUty  of  their 
performance.  At  the  schools,  we  analyzed  data  on  demographic 
characteristics  and  academic  quaUfications  of  students  in  the  1988-89  and 
1989-90  classes  and  reviewed  information  on  school  curriculums  and 
faculty  credentials. 

We  interviewed  DOD,  service  headquarters,  and  academy  officials  to 
determine  what  results  they  expected  the  schools  to  achieve  and  to  obtain 
their  assessment  of  the  schools’  effectiveness.  We  analyzed  data  on 
appointments  to  service  academies  and  academy  performance  of  students 
in  the  1988-89  and  1989-90  classes,  and  data  on  graduation  rates  of  prep 
school  students  from  the  academies.  Since  the  schools  lacked  a  regular 
cost-reporting  system,  we  analyzed  data  supporting  the  cost  estimates 
provided  us  by  the  services  and  interviewed  officials  concerning  the 
estimates.  We  did  not  verify  the  accuracy  of  the  cost  data  provided. 

We  conducted  our  review  from  January  1991  to  December  1991  in 
accordance  with  generally  accepted  government  auditing  standards. 
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Schools’  Missions  Are  Not  Clearly  Defined  and 
Programs  Not  Adequately  Assessed 


DOD  has  not  formalized  the  missions  of  the  prep  schools  since  the  schools 
were  created,  nor  has  it  monitored  their  operations.  The  prep  schools  were 
initially  established  to  prepare  enUsted  personnel  for  the  service 
academies.  The  prep  schools  now  also  serve  civilians  and  are  a  key  source 
for  the  academies  of  females,  minorities,  and  recruited  athletes  identified 
by  academy  athletic  departments.  The  composition  of  the  student  bodies  in 
the  prep  schools  varied  from  school  to  school.  Although  service  academy 
faculty  periodically  review  prep  school  programs,  these  reviews  do  not 
measure  the  schools  against  a  vmiform  set  of  quaUty  standards. 


Prep  Schools  Have 
Diverse  Missions 


Since  their  begiimings,  the  schools  have  acquired  diverse  missions,  and 
serve  civihans  as  well  as  enlisted  personnel.  The  schools  are  now 
important,  according  to  academy  officials,  because  they  prepare  minorities 
and  women  for  academy  admission  and  therefore  promote  diversity  in  the 
officer  corps.  Service  goals  for  enrolling  minorities  in  the  academies  would 
be  difficult  to  meet  without  the  contributions  of  the  prep  schools, 
according  to  service  officials.  The  prep  schools  also  provide  training  to 
recruited  athletes  identified  by  academy  athletic  departments. 

Table  2.1  shows  the  percentage  of  various  subgroups  entering  the  academy 
classes  of  1993  and  1994  that  came  from  the  prep  schools.  The  prep 
schools  are  a  major  source  of  enUsted  personnel  at  the  academies.  The 
prep  schools  do  not  appear  to  be  a  key  source  of  women  at  the  academies, 
supplying  between  9.4  percent  and  12.5  percent  of  the  females  admitted  to 
the  academies.  For  minorities,  the  percentage  coming  from  the  prep 
schools  were  17.2  percent  for  the  MUitary  Academy,  27.9  percent  for  the 
Air  Force  Academy,  and  31.8  percent  for  the  Naval  Academy.  Regarding 
recruited  athletes  at  the  academies,  14  percent  of  those  at  the  Military 
Academy  came  from  the  Army  prep  school,  compared  to  21.5  and  23 
percent,  respectively,  of  the  recruited  athletes  at  the  Naval  and  Air  Force 
academies. 
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Table  2.1 :  Percent  of  Academy  Student 

Subgroups  Coming  From  the  Prep 
Schools  (Academy  Classes  of  1993  and 

Females 

Minorities 

Enlisted 

personnel 

Recruited 

athletes 

1994) 

Military  Academy 

Number  admitted 

309 

436 

170 

549 

Number  coming  from  the 
prep  school 

31 

75 

170 

77 

Percent  coming  from  the 
prep  school 

9.7 

17.2 

100.0 

14.0 

Air  Force  Academy 

Number  admitted 

353 

491 

76 

684 

Number  coming  from  the 
prep  school 

44 

137 

53 

157 

Percent  coming  from  the 
prep  school 

12.5 

27.9 

69.7 

23.0 

Naval  Academy 

Number  admitted 

267 

532 

242 

474 

Number  coming  from  the 
prep  school 

25 

169 

97 

102 

Percent  coming  from  the 
prep  school 

9.4 

31.8 

40.1 

21.5 

The  mission  statements  of  each  of  the  prep  schools  refer  to  preparing 
“selected”  individuals  for  academy  admission.  The  mission  statements  do 
not  mention  specific  groups  such  as  enlisted  personnel,  females, 
minorities,  or  athletes. 

As  reflected  in  the  demographic  makeup  of  the  prep  school  classes,  the 
relative  emphasis  placed  on  preparing  enUsted  personnel,  women, 
minorities,  and  athletes  varies  from  school  to  school.  ‘  Data  on  the 
representation  of  selected  groups  in  the  prep  school  classes  of  1988-89 
and  1989-90  are  shown  in  figure  2.1. 


'Since  the  subgroup  categories  are  not  mutually  exclusive,  the  percentages  cited  for  each  prep  school 
will  sum  to  more  than  100  percent. 
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U.S.  Military 

U.S.  Air  Force 

U.S.  Naval 

Academy  Prep 

Academy  Prep 

Academy  Prep 

School 

School 

School 

1  Females 

1  Minorities 

S 

1  Enlisted  personnel 

1  Recruited  athletes 

Females  represented  roughly  10  percent  of  the  class  at  each  school.  The 
Army  school  had  the  highest  representation  of  enlisted  personnel— about 
55  percent— and  less  representation  of  minorities  than  the  other  schools. 
The  Air  Force  school  had  the  greatest  representation  of  athletes-about 
50  percent— a  high  representation  of  minorities,  and  the  least 
representation  of  enlisted  personnel.  Minorities  comprised  the  largest 
proportion  of  students  at  the  Navy  school,  though  differences  in 
representation  between  the  groups  at  the  Navy  school  were  less  marked 
than  at  the  other  two  schools.  There  is  some  double-counting  in  these 
percentages  due  to  individuals  falling  into  more  than  one  subgroup 
category.  For  example,  about  20  percent  of  minority  students  at  the  Air 
Force  Academy  prep  school  were  also  recruited  athletes  and  are  counted  in 
both  categories.  The  comparable  figures  at  the  other  prep  schools  were  15 
percent  at  the  MiUtary  Academy  prep  school  and  12  percent  at  the  Naval 
Academy  prep  school. 
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Prep  School  Students  Have  Prep  school  students  have  weaker  qualifications  than  other  cadets  and 
Weaker  Qualifications  Than  niidshipmen  appointed  to  the  academies.  The  academies  consider  an 
Most  Academy  Appointees  applicant’s  academic  record  and  leadership  potential  as  well  as  scores  on 

standardized  tests.  Prep  school  students  had  combined  average  scores  on 
the  verbal  and  math  portions  of  the  Scholastic  Aptitude  Test  (sat)— one 
indicator  of  academic  potential— that  were  from  149  points  lower  (at  the 
Navy  school)  to  191  points  lower  (at  the  Air  Force  school)  than  the  average 
for  all  cadets  and  midshipmen.  Relative  average  SAT  math  scores  for 
various  groups  of  prep  school  students  in  the  1988-89  and  1989-90  classes 
and  for  all  cadets  and  midshipmen  in  the  academy  classes  these  student 
entered  are  shown  in  figure  2.2 


Figure  2.2:  SAT  Math  Scores  of  Prep 
School  Students 
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At  each  prep  school,  enlisted  personnel  had  the  highest  average  SAT  math 
scores,  particularly  at  the  Air  Force  school.  Females  had  the  lowest 
average  scores  at  the  Army  and  Air  Force  schools,  while  recruited  athletes 
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had  the  lowest  average  scores  at  the  Navy  school.  Although  average  scores 
for  prep  school  students  were  lower  than  the  averages  for  all  cadets  and 
midshipmen,  the  percent  of  the  prep  school  students  in  the  1988-89  and 
1989-90  classes  with  scores  above  the  academy  admissions  departments 
minimum  score  guidelines  ranged  from  22  percent  at  the  Navy  school  to 
30  percent  at  the  Air  Force  school. 


Prep  Schools  Not 
Adequately  Assessed 


The  prep  schools  are  not  accredited,  and  the  strength  of  the  credentials  of 
their  faculty  varied.  Members  of  the  academy  faculties  have  periodically 
assessed  the  operations  of  their  respective  prep  schools,  but  their 
assessments  have  not  been  made  against  any  established  criteria.  The 
intervals  of  time  between  assessments  vary  from  1  year  to  5  years. 


Accreditation  Not  Seen  As  Although  accreditation  reviews  could  compare  the  mihtary  services’  prep 
Worthwhilp  for  fhp  Srhools  schools  against  the  standards  applied  to  most  recognized  prep  schools, 

colleges  or  universities,  school  officials  identified  difficulties  that  seeking 
accreditation  would  present.  As  post-secondary  institutions,  school 
officials  noted  that  their  schools  are  not  required  to  be  accredited.  They 
also  stated  that  some  of  the  standards  that  accrediting  agencies  require 
institutions  to  meet  may  not  be  appropriate  for  their  prep  schools.  Officials 
at  the  Army  school  investigated  obtaining  accreditation  and  were  told  by 
the  potential  accreditation  agency  that,  since  they  offered  a  1-year  program 
instead  of  the  2-year  program  of  a  typical  junior  college,  they  could  not 
obtain  accreditation.  Officials  at  the  Air  Force  prep  school  stated  that,  if 
the  school  were  accredited  as  a  junior  college,  the  eUgibihty  of  athletes 
enrolled  in  the  school  to  compete  in  varsity  sports  at  the  academy  would  be 
affected. 


Faculty  Credentials  Vary  The  makeup  of  the  faculty  in  terms  of  credentials  and  experience  varied 

from  school  to  school.  Data  reflecting  the  credentials  of  faculty  at  the  prep 
schools  are  shown  in  table  2.2. 
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Credentials 

Prep  school 

Criterion 

Army 

Air  Force 

Navy 

Average  teaching  experience  (years) 

15.3 

4.2 

8.3 

Percent  of  faculty  with  a: 

Masters  degree 

65 

53 

22 

Doctoral  degree 

24 

0 

4 

Percent  of  faculty  certified  as  teachers^ 

59 

24 

33 

^Includes  faculty  members  who  have  been  certified  as  teachers  by  state  education  authorities  at  any 
time,  whether  the  certification  is  now  in  effect,  or  not. 


Most  of  the  1 7  faculty  members  at  the  Army  school  were  civilians;  only 
29  percent  were  mihtary  personnel.  All  of  the  Air  Force  school’s  1 7  faculty 
members  were  military  personnel,  while  at  the  Navy  school,  70  percent  of 
its  27  faculty  members  were  military. 

Mihtary  facirlty  members  are  subject  to  periodic  reassignment.  As  we  noted 
in  a  1991  study  of  the  service  academies,  accrediting  agencies  have  raised 
concerns  about  the  instability  and  lack  of  teaching  experience  that  result 
from  frequent  turnover  of  mihtary  facirlty  at  the  academies.^ 

The  data  in  table  2.2  show  that  the  faculty  at  the  Army  school  had  more 
teaching  experience,  held  more  advanced  degrees,  and  had  a  higher 
percentage  of  certified  teachers  than  the  faculty  at  the  other  two  schools. 
The  faculty  at  the  Air  Force  school,  made  up  entirely  of  mihtary  personnel, 
had  the  least  teaching  experience  of  the  three  schools,  but  held  more 
advanced  degrees  than  did  the  more  experienced  faculty  at  the  Navy 
school. 


No  Established  Criteria  for  The  service  academies  have  conducted  periodic  program  reviews  of  the 
Assessing  the  Schools  prep  schools.  The  Air  Force  Academy  conducts  a  review  annuahy,  the 

Naval  Academy  conducts  a  review  every  3  years.  The  Mihtary  Academy 
completed  its  first  review  in  1986  and  indicated  that  it  planned  to  conduct 
a  fohow-up  review  5  years  later.  For  each  school,  members  of  the  academy 
faculty  form  the  review  teams,  which  also  generahy  include  representatives 
of  academy  athletic  and  admissions  departments.  These  reviews  reflect  an 
informed  Judgment  about  the  quality  of  the  schools’  programs,  but  do  not 
measure  the  schools  against  a  uniform  set  of  quahty  standards. 


^DOD  Service  Academies:  Improved  Cost  and  Performance  Monitoring  Needed  (GAO/NSIAD-91-79 
July  16, 1991).  “  - - — - 
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Academy  reviewers  have  surfaced  concerns  regarding  the  schools’ 
programs  and  action  has  been  taken  to  address  some  of  these  concerns. 
The  1986  review  of  the  Army  school,  for  example,  concluded  that  the 
excessive  work  load  of  instructors  reduced  their  ability  to  prepare  effective 
lessons.  The  teaching  load  was  consequently  dropped  from  four  to  three 
classes  a  day.  The  1989  review  at  the  Navy  school  foimd  problems  in 
acquiring  textbooks,  and  stated  that  a  sufficient  supply  of  math  textbooks 
had  not  been  delivered  until  several  weeks  after  instruction  had  begun.  The 
reviewers  concluded  that  more,  higher-level  attention  to  these  problems 
was  needed  to  ensure  an  effective  course  of  study.  In  1990,  budgetary 
supervision  of  the  Naval  Academy  prep  school  was  transferred  to  the  Naval 
Academy. 

The  reviews  by  the  academy  faculties  are  the  only  assessments  the  prep 
schools  have  been  subject  to.  The  prep  schools  have  not  received  any 
independent  reviews  or  evaluations  by  DOD  or  educational  accreditation 
agencies. 


Page  17 


GAO/NSIAD-92-57  Academy  Preparatory  Schools 


Chapter  3 _ _ _ _ 

DOD  Cannot  Presently  Evaluate  the  Prep 
Schools 


DOD  has  not  estabhshed  the  criteria  it  needs  to  evaluate  the  prep  schools. 
First,  DOD  has  not  estabhshed  goals  for  the  schools’  success  in  preparing 
students  for  the  academies.  The  percentage  of  students  who  obtain 
academy  appointments  varies  from  school  to  school  and  prep  school 
graduates’  performance  at  the  academies  was  generally  below  average. 
Second,  DOD  has  not  issued  guidelines  on  how  the  services  should  estimate 
the  cost  of  operating  the  schools  and  does  not  require  regular  cost  reports. 
Based  on  estimates  provided  to  us  by  the  services  and  additional  costs  we 
determined  should  be  included,  it  cost  an  average  of  about  $48,900  for 
each  academy  cadet  or  midshipman  the  prep  schools  produced.  This 
amount  is  about  as  much  or  more  than  it  costs  to  send  someone  to  the 
corresponding  academy  for  a  year  and  about  2.5  to  4  times  the  cost  of 
sending  a  student  to  a  top  college  for  a  year. 


Prep  School  Students’ 
Achievements  Varied 


The  schools  accumulate  data  on  various  measures  of  their  performance  in 
preparing  students  for  the  service  academies,  but  no  guidelines  for  these 
measures  have  been  established.  DOD  has  not  estabhshed  goals  for  the 
schools,  either  in  terms  of  the  percentage  of  students  that  receive  an 
academy  appointment  or  that  graduate  from  the  academies.  Headquarters 
officials  in  each  service  told  us  that  they  were  familiar  with  the  schools’ 
performance  and  were  satisfied  with  them.  The  services,  however,  have  not 
estabhshed  specific  performance  targets  they  expect  the  schools  to  meet. 


AppointlTlGnt  Rates  Varied  The  Air  Force  and  Navy  schools  achieved  a  higher  appointment  rate  than 

the  Army  school.^  Appointment  rates  for  students  enrobed  in  the  1988-89 
and  1989-90  classes  at  the  Army  prep  school  were  about  54  percent, 
compared  to  just  over  70  percent  for  the  Air  Force  and  Navy  prep  schools. 
Overah  appointment  rates  and  rates  for  the  specific  groups  we  analyzed  are 
shown  in  figure  3.1. 


'Under  the  law  establishing  the  Mihtary,  Air  Force,  and  Naval  academies,  cadets  and  midshipmen  must 
be  appointed  to  the  academies  by  the  President;  accordingly,  an  offer  of  admission  to  one  of  the 
academies  is  referred  to  as  an  appointment. 
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The  relative  success  of  the  various  student  subgroups  varied  from  school 
to  school.  Appointment  rates  for  females  were  higher  than  the  overall  rate, 
except  at  the  Navy  school,  where  the  female  appointment  rate  was 
substantially  lower.  The  appointment  rate  for  minorities  was  comparable  to 
the  overall  rate  at  each  school.  Except  at  the  Army  school,  appointment 
rates  for  enlisted  personnel  were  higher  than  the  overall  rate.  Appointment 
rates  for  recruited  athletes  were  lower  than  the  overall  rate  at  each  school. 


The  academic  performance  of  prep  school  students  at  the  academies  was 
weaker  generally  than  that  of  other  cadets  and  midshipmen.  On  a  4.0 
scale,^  the  average  academic  grades  of  prep  school  students  in  the  1993 
academy  classes  (the  1988-89  prep  school  classes)  ranged  from  0.26  lower 
than  that  for  all  cadets  at  the  Military  Academy  to  0.35  points  lower  at  the 


^Grading  at  the  academies  is  done  using  a  4.0  scale,  with  an  “A”  receiving  4  quality  points  for  each^ 
credit  a  course  carries,  a  “B”  receiving  3  quality  points,  and  so  on  down  to  no  quality  points  for  an  “F.” 
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Air  Force  Academy.  We  analyzed  academic  and  military  grades  of  prep 
school  students  in  the  1993  academy  classes  because  their  grades 
represented,  at  the  time  of  our  field  work,  three  semesters  of  work  at  the 
academies  and  would  make  their  grades  a  more  reliable  measure  of 
performance  than  those  of  the  academy  classes  of  1994  whose  grades 
would  represent  only  one  semester’s  work.  Average  relative  grades  for 
specific  groups  are  shown  in  figure  3.2. 


Figure  3.2:  Academy  Grade  Point 
Averages  of  Prep  Schooi  Students 
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Grade  point  averages  are  cumulative  through  the  fall  1990  semester. 


At  each  academy,  enlisted  prep  school  graduates  had  higher  average 
grades  than  other  prep  school  graduates.  Prep  school  females  had  lower 
average  grades  than  other  prep  school  graduates  at  the  Military  and  Air 
Force  academies.  At  the  Naval  Academy,  the  average  grades  of  female  prep 
school  graduates  were  fairly  comparable  to  other  prep  school  graduates. 
Prep  school  minorities  also  had  poorer  average  grades  than  other 
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graduates,  but  had  more  nearly  comparable  average  grades  at  the  Air 
Force  Academy.  Recruited  athletes  from  the  prep  schools  also  had  lower 
average  grades  than  other  prep  school  graduates,  particularly  at  the 
Military  Academy. 

The  average  mUitary  performance  grades  for  prep  school  students  were 
comparable  to  the  average  grades  for  all  cadets  and  midshipmen.®  On  a  4.0 
scale,  the  average  miUtary  performance  grades  for  prep  school  students  in 
the  1993  academy  classes  ranged  from  0.01  points  lower  (at  the  Naval 
Academy)  to  0. 12  points  lower  (at  the  Air  Force  Academy)  than  the 
average  grades  for  all  cadets  and  midshipmen.  Relative  average  military 
performance  grades  for  the  selected  groups  analyzed  and  for  all  cadets  and 
midshipmen  are  shown  in  figure  3.3. 


Figure  3.3:  Academy  Military 
Performance  Grade  Averages  of  Prep 
School  Students 
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Military  performance  grade  averages  are  cumulative  through  the  fall  1990  semester. 


^At  each  academy,  cadets  are  assigned  a  grade  that  reflects  their  performance  in  the  mihtary  aspects  of 
the  academy  course  that  is  distinct  from  their  academic  grade  point  average. 
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Graduation  and  Career 
Retention  Rates  Reflect 
Service  Trends 


Enlisted  prep  school  graduates  had  higher  average  miUtary  performance 
grades  than  other  prep  school  graduates.  At  the  Military  and  Naval 
academies,  they  had  higher  average  grades  than  the  general  cadet  or 
midshipman  population.  Prep  school  females  had  the  lowest  average 
miUtary  performance  grades  at  each  academy.  Prep  school  minorities  had 
lower  average  militaiy  grades  than  nonminority  prep  school  graduates. 
Prep  school  recruited  athletes  also  had  lower  average  military  grades  than 
other  graduates,  particularly  at  the  MiUtary  Academy. 

The  academies  have  done  Uttle  analysis  of  how  the  schools  affect  academy 
performance.  A  1985  study  conducted  at  the  U.S.  MiUtary  Academy, 
however,  compared  the  performance,  during  the  first  2  years  at  the 
Academy,  of  cadets  in  the  classes  of  1984  through  1986  who  entered  the 
Academy  directly  and  those  who  entered  the  Academy  after  a  year  at  the 
prep  school.  This  study  found  that  prep  school  students  performed  as 
would  be  expected  based  on  their  record  before  attending  the  school.  The 
study  concluded  that  the  effect  of  prep  school  academic  training  was 
minimal. 


Academy  graduation  rates,  both  for  cadets  and  midshipmen  admitted 
directly  to  the  academies  and  for  prep  school  students,  varied  from 
academy  to  academy.  At  the  Naval  Academy,  about  76  percent  of  the 
midshipmen  admitted  directly  to  the  classes  of  1986  through  1990 
graduated;  about  78  percent  of  the  prep  school  students  in  these  classes 
graduated.  Graduation  rates  for  prep  school  students  at  the  MUitaiy  and 
Air  Force  academies  were  lower  (69  percent  and  65  percent,  respectively) 
as  were  graduation  rates  for  cadets  admitted  directly  (71  percent  and 
70  percent,  respectively).  Graduation  rates  at  the  three  academies  are 
shown  in  figure  3.4. 
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Figure  3.4:  Academy  Graduation  Rates 
of  Prep  School  Students 


80  Graduation  rate  (percent) 


U.S.  Military  U.S.  Air  Force 

Academy  Academy 


U.S.  Navai 
Academy 


Non -prep  school  cadets  or  midshipmen 
Prep  school  cadets  or  midshipmen 


Although  the  services  have  done  little  analysis  of  prep  school  students’ 
performance  as  officers,  the  data  that  is  available  indicate  that  their 
experience  is  similar  to  that  of  other  academy  graduates.  The  Army  has 
accumulated  data  on  the  graduating  classes  of  1954-1968  that  indicate 
prep  school  students  were  somewhat  more  Ukely  to  remain  in  the  service 
than  other  academy  graduates.  However,  since  the  Army  prep  school  has  a 
higher  proportion  of  enlisted  personnel  and  their  enlisted  time  would  count 
toward  retirement,  somewhat  higher  retention  could  be  expected.  A  1986 
study  prepared  at  the  Air  Force  Academy  compared  the  career  retention 
and  progression  of  prep  school  and  non-prep  school  academy  graduates 
from  the  classes  1962-1986.  This  study  concluded  that  the  experience  of 
the  two  groups  was  essentially  the  same,  with  prep  school  graduates 
performing  better  for  some  measures  and  non-prep  school  graduates 
performing  better  for  others. 
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Good  Data  on  School 
Operating  Costs  Are 
Not  Available 


Services’  Cost  Estimating 
Methods  Differed 


DOD  h£us  limited  information  on  the  cost  of  operating  the  prep  schools. 
While  DOD  has  long  required  the  academies  to  report  their 
cost-per-graduate,  it  heis  not  imposed  a  similar  requirement  on  the  prep 
schools.  Some  cost  information  on  the  schools  was  developed  in 
connection  with  recent  DOD  studies  of  officer  commissioning  programs. 
This  information,  however,  was  gathered  on  a  one-time  basis,  and  DOD  has 
not  issued  instructions  requiring  uniform  estimates  of  prep  school 
operating  costs. 

The  service  estimates  of  prep  school  costs  indicated  that,  for  fiscal  year 
1990,  the  cost  for  all  prep  schools  totaled  $24.9  milhon.  Prep  school 
students  receive  normal  enlisted  pay  and  benefits  whether  they  graduate  or 
not,  and  student  pay  and  benefits  comprise  about  54  percent  of  total  costs. 


Determining  the  cost  of  operating  the  prep  schools,  however,  presents 
some  difficulties.  Costs  paid  directly  from  the  schools’  operating  budgets 
can  be  readily  determined.  However,  pay  and  benefits  for  mihtary 
personnel  and  the  cost  of  certain  support  services— such  as  property 
maintenance,  utihties,  food  service,  and  so  forth-are  not  charged  to  the 
schools’  operating  budgets.  These  costs  must  be  estimated. 

The  approaches  the  three  services  took  to  estimating  operating  costs 
differed.  The  Air  Force  Academy  Comptroller  developed  cost  estimates  for 
the  Air  Force  school  along  with  the  Academy’s  estimate  of  its  cost  per 
graduate.  The  Comptroller  prepared  a  document  outlining  a  detailed, 
formal  method  for  developing  this  estimate.  The  process  used  to  develop 
cost  estimates  for  the  Army  and  Navy  schools  was  less  formalized.  To 
estimate  the  significance  of  differing  estimating  approaches,  we  adapted 
the  Air  Force’s  approach  to  the  data  available  on  selected  elements  of  fiscal 
year  1990  costs  at  the  Army  and  Navy  schools. 

Militaiy  pay  was  one  area  where  we  found  major  differences  in  estimating 
approaches.  DOD  provides  guidance  to  the  services  on  computing 
composite  cost  rates  for  each  officer  and  enlisted  pay  grade  that  reflect  the 
cost  of  benefits  mihtary  personnel  receive  as  weU  as  direct  pay.  The  Air 
Force  used  these  composite  rates  to  estimate  military  pay  costs.  The  Army 
used  rates  that  reflected  only  direct  pay  and  therefore  its  estimate  of 
mihtary  pay  costs  w^ls  substantiahy  understated.  The  Navy  used  a  single 
cost  rate  for  ah  enhsted  personnel— both  staff  and  students— that  reflected 
the  average  pay  grade  of  ah  Navy  personnel.  Since  most  students  enter  the 


Page  24 


GAO/NSIAD-92-57  Academy  Preparatory  Schools 


Chapter  3 

DOD  Cannot  Presently  Evaluate  the  Prep 
Schools 


prep  school  at  the  lowest  enhsted  pay  grade,  Navy  mihtary  pay  costs  were 
substantially  overstated. 

Support  services  were  another  area  in  which  we  found  differences  in  the 
services’  estimates.  For  example,  the  Air  Force  estimated  property 
maintenance  costs  by  determining  what  percentage  of  the  total  building 
space  at  the  Academy  the  prep  school  occupied.  The  Air  Force  apphed  this 
percentage  to  the  fiscal  year  1990  cost  of  the  property  maintenance 
function  to  arrive  at  an  estimate.  The  Army  followed  a  similar  process,  but 
used  fiscal  year  1988  costs  (not  adjusted  for  inflation)  and  excluded  the 
cost  of  supervising  and  managing  the  maintenance  function.  The  Navy  did 
not  estimate  a  cost  for  property  maintenance. 

The  effect  of  these  differences  on  the  services’  cost  estimates  was 
substantial.  Differing  administrative  and  financial  records  maintained  at  the 
schools  made  it  difficult  to  apply  the  Air  Force’s  estimating  methodology 
consistently  to  all  prep  school  costs.  Accordingly,  we  did  not  develop  a 
complete  estimate  of  the  cost  of  operating  the  schools.  Our  review, 
however,  indicates  that  the  services’  estimates  did  not  include  about 
$2.9  million  in  costs.  The  results  of  our  review  are  summarized  in 
table  3.1. 


Table  3.1 :  Costs  Not  Included  in  Fiscal 
Year  1990  Prep  School  Operating  Cost 

Dollars  in  thousands 

Estimates 

Prep  schools 

Army 

Air  Force 

Navy 

Total 

Reported  cost  estimate 

$6,274 

$8,446 

$10,171 

$24,890 

Costs  not  included  in  estimates 

Faculty  and  staff  pay 

888 

0 

204 

1,092 

Student  pay 

2,143 

0 

(2,247) 

(104) 

Support  services^ 

319 

55 

1,530 

1,904 

Total  costs  not  included  in 
estimates 

3,350 

55 

(513) 

2,892 

Adjusted  total  cost 

$9,624 

$8,501 

$9,658 

$27,783 

Number  of  students  admitted  to 
an  academy 

158 

167 

243 

568 

Average  Cost  per  student 
admitted  to  an  academy 

$60.9 

$50.9 

$39.8 

$48.9 

®Our  review  includeci  estimates  of  costs  for  property  maintenance,  utilities,  food  service,  and  health  care. 


As  shown  in  table  3.1,  the  cost  per  cadet/midshipmen  actually  placed  at  a 
federal  service  academy  varied  significantly  across  the  three  schools.  The 
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Navy  prep  school’s  cost  per  placement  was  the  lowest,  at  about  $39,800, 
followed  by  the  Air  Force  prep  school  at  about  $50,900,  and  the  Army  prep 
school  at  about  $60,900. 

As  a  point  of  comparison,  for  fiscal  year  1989,  the  1-year  cost  per  student 
attending  the  service  academies  ranged  from  about  $39,500  at  the  Naval 
Academy,  to  about  $52,900  at  the  Air  Force  Academy,  to  about  $56,900  at 
the  Military  Academy.  Also  by  way  of  comparison,  the  average  cost  of 
tuition,  fees,  room,  and  board  for  attending  1  of  27  highly  selective  4-year 
colleges  that  offer  a  general  engineering  degree  was  about  $15,800  in 
1990.^  Although  the  fees  colleges  charge  may  not  represent  their  true  costs 
of  providing  education,  the  education  costs  the  prep  schools  reported  far 
exceeded  the  average  charges  of  these  schools. 


Potential  for  Reducing  Costs  dod  has  recently  expressed  concern  about  the  cost  of  operating  the  prep 
Is  Difficult  to  Assess  schools.  As  part  of  an  overall  review  of  programs  that  produce  military 

officers,  a  dod  study  commissioned  by  the  Deputy  Secretary  of  Defense 
recommended  that  the  three  services’  prep  schools  be  consolidated.  The 
study  concluded  that  significant  savings  would  result  by  doing  so.  DOD  did 
not  adopt  this  recommendation,  but  directed  the  services  to  develop  plans 
to  reduce  the  cost  of  operating  their  schools.  The  Navy,  for  example,  plans 
to  reduce  costs  by  reducing  enrollment  in  its  school. 

The  potential  for  near-term  cost  reduction  is,  however,  difficult  to  assess 
because  some  costs  -will  not  change  in  the  short  run,  regardless  of  actions 
taken  concerning  the  schools.  For  example,  officials  at  the  Army  school 
noted  that  their  facilities  require  some  heating,  whether  occupied  or  not,  to 
prevent  damage  to  the  structures.  Consequently,  even  permanently  closing 
the  school  would  not  ehminate  all  the  utihties  expenses  attributed  to  its 
operation.  Similarly,  the  dining  halls  at  the  Air  Force  and  Navy  schools  feed 
both  prep  school  students  and  enlisted  personnel.  A  part  of  the  cost  of 
maintaining  the  dining  haUs  and  managing  the  food  service  operation, 
which  do  not  vary  directly  with  the  number  of  persons  fed,  were  attributed 
to  the  prep  schools.  Consequently,  reduced  prep  school  enrollment  would 
not  necessarily  produce  commensurate  cost  reductions. 


This  figure,  comes  from  Peterson’s  Guide  to  Four-Year  Colleges:  1990  and  represents  the  average  cost 
of  tuition,  fees,  room,  and  board  for  the  27  highly  selective  colleges  offering  an  undergraduate  general 
engineering  degree  that  provided  complete  information.  “Highly  selective”  colleges  were  defined  as 
those  whose  admissions  standards  were  rated  either  “very  difficult”  or  “most  difficult"— the  ratings 
assigned  to  the  service  academies.  In  the  case  of  state-operated  colleges  that  charge  differing  tuition 
rates  to  state  residents  and  non-residents,  the  higher  rates  were  used  for  this  comparison. 
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In  a  broader  context,  the  incomplete  and  inconsistent  cost  data  available 
on  the  prep  schools  limits  dod’s  abihty  to  oversee  their  costs  effectively. 
For  example,  comparing  the  costs  of  operating  the  schools  across  service 
lines  to  identify  efficient  management  practices  may  produce  misleading 
results.  Lower  persoimel  or  support  service  costs  at  one  school  than  at  the 
others  may  indicate  that  the  low-cost  school  is  operated  more  efficiently, 
that  costs  have  been  omitted  from  its  estimates,  or  that  the  services  have 
chosen  to  fund  their  prep  schools  at  different  levels. 
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Conclusions 


DOD  has  not  specified  the  role  the  prep  schools  should  play  in  filling  the 
services’  need  for  officers.  Each  of  the  schools  appears  to  be  pursuing 
somewhat  different  goals.  The  Army  school  has  emphasized  preparing 
enUsted  personnel,  the  Air  Force  school  has  emphasized  preparing 
recruited  athletes  and  minorities,  while  the  Navy  school  has  not 
emphasized  preparation  of  any  particular  subgroup  more  than  another. 

DOD  also  lacks  information  on  the  quality  of  the  schools’  programs.  The 
strength  of  faculty  credentials  varied  among  the  schools.  Although 
academy  faculty  have  conducted  periodic  reviews  at  the  schools,  the 
intervals  between  reviews  have  varied  widely.  'The  prep  schools  have  not 
been  assessed  against  any  established  criteria  and  they  have  not  been 
subject  to  the  accreditation  reviews  that  most  recognized  post-secondary 
schools  undergo.  Outside  of  the  review  by  academy  faculty,  the  prep 
schools  are  not  subject  to  any  oversight  evaluations. 

DOD  also  lacks  the  tools  it  needs  to  determine  whether  the  schools  are 
effective.  The  schools’  success  in  placing  students  at  the  service  academies 
varied.  Academy  officials  cite  the  prep  schools  as  an  important  source  of 
women  and  minorities  helping  them  meet  their  goals  for  a  diverse  student 
body.  Our  review  showed  the  schools  supplied  12.5  percent  or  less  of  the 
females  and  between  17.2  and  31.8  percent  of  the  minorities  who  entered 
the  academies  in  the  classes  of  1993  and  1994. 

The  academic  and  military  performance  of  prep  school  students  at  the 
academies  was  somewhat  below  the  average  of  cadets  and  midshipmen 
who  did  not  attend  a  prep  school.  However,  in  terms  of  graduation  rates, 
prep  school  students  had  a  higher  graduation  rate  than  other  midshipmen 
at  the  Naval  Academy  but  were  slightly  below  the  graduation  rates  of  other 
cadets  at  the  Militaiy  and  Air  Force  academies.  Since  DOD  hcis  not 
estabUshed  performance  goals  for  the  schools  it  does  not  have  a  basis  for 
evaluating  whether  the  results  the  schools  achieved  were  satisfactory. 

DOD  has  expressed  concern  about  the  cost  of  operating  the  prep  schools. 
However,  it  has  not  issued  guidelines  on  how  the  services  should  estimate 
the  cost  of  operating  the  schools  and  does  not  require  regular  cost  reports. 
Our  review  indicated  that  the  Army,  Air  Force,  and  Navy  preparatory 
programs  cost  about  $60,900,  $50,900,  and  $39,800,  respectively,  for 
each  student  placed  at  an  academy.  These  costs  are  about  as  much  or  more 
than  the  cost  of  sending  a  student  to  the  corresponding  academy  for  a  year 
and  much  higher  than  the  cost  of  sending  someone  to  a  high  quality  college 
or  university. 
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Recommendations 


We  recommend  that  the  Secretary  of  Defense 

determine  what  role  the  prep  schools  should  play  among  the  services’ 
officer  production  programs  and  direct  the  services  to  clarify  their  school 
missions  accordingly, 

consult  with  recognized  authorities  on  educational  quaUty  to  determine 
what  standards  would  be  appropriate  to  apply  to  the  prep  schools  in  terms 
of  faculty  and  curriculum  and  require  periodic  reviews  by  qualified 
independent  parties  to  assure  that  the  schools  meet  the  standards,  and 
establish  standardized  guidelines  for  the  services  to  use  in  estimating 
school  costs. 

Once  performance  standards  and  cost  estimating  guidelines  are  in  place, 
we  recommend  that  the  Secretary  require  periodic  analysis  of  the 
cost-effectiveness  of  continuing  to  operate  the  prep  schools.  Consideration 
should  be  given  to  the  role  the  schools  play  in  helping  the  academies  to 
obtain  adequate  numbers  of  qualified  women  and  minorities.  Given  the 
relatively  high  cost  per  cadet/midshipmen  placed  at  an  academy, 
consideration  should  also  be  given  to  alternative  methods  of  providing 
academy  preparation,  such  as  using  existing  educational  institutions  or  the 
private  sector. 


Agency  Comments  and 
Our  Evaluation 


In  commenting  on  a  draft  of  this  report,  DOD  concurred  with  the  principal 
findings  and  recommendations.  DOD  indicated  that  it  was  taking  several 
actions  to  improve  cost  reporting  efficiency,  management,  and  supervision 
of  the  prep  schools.  DOD  also  stated  that  it  plans  to  work  with  the  services 
to  develop  a  consistent  mission  statement  for  these  schools  and  an 
approved  mission  statement  will  be  approved  by  May  1992. 


DOD  stated  that  it  had  contacted  the  American  Council  on  Education  for 
assistance  in  identifying  approaches  to  evaluating  the  academic  quahty  of 
the  prep  school  programs.  DOD  indicated  that  an  independent  evaluation  of 
the  quality  of  instruction  and  faculty  at  these  schools  will  begin  in  the 
1992-93  academic  year. 


DOD  stated  that  it  had  developed  an  instruction  for  reporting  standardized 
prep  school  costs  and  expects  to  pubUsh  this  guidance  by  spring  of  1992. 
It  also  indicated  that  the  instruction  addresses  all  budgeted  and 
programmed  costs  of  operation  for  the  academies  and  preparatory 
schools.  DOD  also  said  that  a  provision  of  the  new  instruction  calls  for 
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cost-effectiveness  to  be  evaluated  annually,  beginning  with  the  1992-93 
academic  year. 

DOD  raised  a  question  regarding  the  comparability  of  academy  prep  school 
costs  and  the  cost  of  sending  personnel  to  a  pubUc  or  private  institution. 
DOD  noted  that  the  tuition  and  fees  charged  by  civilian  colleges  and 
universities  cover  only  a  portion  of  their  total  institutional  costs.  While  we 
agree  that  this  is  true,  the  fact  remains  that  if  DOD  used  such  institutions  to 
provide  academy  preparation,  it  would  only  incur  the  direct  charges. 

DOD  stated  that  the  prep  schools’  programs  are  tailored  to  enabling 
students  to  succeed  at  the  academies,  in  both  academic  and  military 
aspects  of  the  programs.  Nevertheless,  DOD  stated  that  it  would  examine 
the  merits  of  alternative  programs  and  was  considering  a  number  of 
potential  actions,  including  possible  consolidation  of  the  preparatory 
schools.  DOD  said  its  review  of  alternative  programs  will  be  completed  by 
June  1993. 

DOD  comments  are  included  in  their  entirety  hi  appendix  I. 
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Note;  GAO  comments 
supplementing  those  in  the 
report  text  appear  at  the 
end  of  this  appendix. 


FORCE  MANAGEMENT 

and  personnel 


ASSISTANT  SECRETARY  OF  DEFENSE 

WASHINGTON.  D.C.  20301-4000 


FEB  2  4  1992 


Mr.  Frank  C.  Conahan 
Assistant  Comptroller  General 

National  Security  and  International  Affairs  Division 
U.S.  General  Accounting  Office 
Washington,  DC  20548 


Dear  Mr.  Conahan: 


This  is  the  Department  of  Defense  (DoD)  response  to  the  General 
Accounting  Office  (GAO)  draft  report  entitled,  "DOD  SERVICE  ACADE¬ 
MIES:  Academy  Preparatory  Schools  Need  a  Clearer  Mission  and  Better 
Oversight"  (GAO  Code  391141/OSD  Case  8928) .  The  Department  concurs 
with  the  principal  findings  and  recommendations  of  the  draft  report. 

As  part  of  increased  oversight  of  officer  accession  programs,  the 
Department  has  initiated  several  actions  to  improve  cost  reporting 
and  efficiency,  management,  and  supervision  of  these  programs.  The 
Department  supports  many  of  the  functions  served  by  academy  prepara¬ 
tory  schools,  including  minority  and  enlisted  personnel  input  to  the 
academies.  We  will  examine  the  full  range  of  measures  to  improve  the 
operation  of  these  schools. 

Detailed  DoD  comments  on  the  draft  report  are  provided  in  the 
enclosure.  The  Department  appreciates  the  opportunity  to  respond  to 
the  draft  report. 


Enclosure : 
As  Stated 


Sincerely, 
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GAO  DRAFT  REPORT  -  DATED  JANUARY  2,  1992 
"DOD  SERVICE  ACADEMIES:  ACADEMY  PREPARATORY 
SCHOOLS  NEED  A  CLEARER  MISSION  AND  BETTER  OVERSIGHT" 

(GAO  CODE  391141)  OSD  CASE  8928 

DEPARTMENT  OF  DEFENSE  COMMENTS 

★  *  *  *  * 

FINDINGS 

•  FINDING  A:  Preparatory  Schools  Have  Diverse  Missions  and  Demo¬ 

graphics  .  The  GAO  reported  that,  since  their  beginnings,  the 
preparatory  schools  have  had  diverse  missions — including  prepar¬ 
ing  minorities  and  women  for  academy  admission,  thereby  promoting 
diversity  in  the  officer  corps.  The  GAO  also  noted  that  the 
preparatory  schools  provided  training  to  recruited  athletes 
identified  by  academy  athletic  departments.  The  GAO  reported 
that  the  preparatory  schools  are  the  only  source  of  enlisted 
personnel  at  the  Military  Academy  and  a  major  source  of  enlisted 
See  comment  1 .  personnel  at  the  Naval  and  Air  Force  Academies. 

The  GAO  found,  however,  that  the  preparatory  schools  do  not 
appear  to  be  a  key  source  of  women  at  the  academies,  supplying 
only  9.4  to  12.5  percent  of  the  females.  The  GAO  observed  that, 
for  minorities,  the  percentages  coming  from  preparatory  schools 
were  17.2  percent  for  the  Military  Academy,  27.9  percent  for  the 
Air  Force  Academy  and  31.8  percent  for  the  Naval  Academy.  The 
GAO  reported  that  14  percent  of  the  recruited  athletes  at  the 
Military  Academy  also  are  from  the  preparatory  school,  compared 
with  21.5  and  23  percent  for  the  Naval  and  Air  Force  Academies. 
The  GAO  found  that  (1)  the  Army  preparatory  school  had  the 
highest  representation  of  enlisted  personnel,  about  55  percent, 
(2)  the  Air  Force  school  had  the  highest  representation  of 
athletes,  about  50  percent,  and  (3)  minorities  comprised  the 
largest  proportion  of  the  students  at  the  Navy  preparatory 
school .  The  GAO  reported  that  the  preparatory  school  students 
had  combined  average  scores  on  the  verbal  and  math  portion  of  the 
Scholastic  Aptitude  Test  149  to  191  points  lower  than  the  average 
for  all  cadets  and  midshipmen.  The  GAO  concluded  that  the 
demographic  makeup  of  the  preparatory  school  classes  reflects  the 
relative  emphasis  each  Military  Service  places  on  preparing 
enlisted  personnel,  women,  minorities,  and  athletes.  The  GAO 
further  concluded  that  the  DoD  has  not  specified  the  role  the 
preparatory  schools  should  play  in  filling  the  need  of  the 
Military  Services  for  officers,  leading  each  school  to  pursue 
Now  on  pp.  11-13.  somewhat  different  goals.  (pp . 14-18/GAO  Draft  Report) 
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DoD  Response:  Partially  concur.  The  preparatory  school  is  not 
the  sole  source  of  enlisted  input  into  the  Military  Academy;  a 
number  of  active  duty,  reserve  and  National  Guard  enlisted 
members  are  admitted  directly  into  the  academies  each  year. 

•  FINDING  B:  Preparatory  Schools  Not  Assessed  Adequately.  The  GAO 

reported  that  the  preparatory  schools  are  not  accredited  and  the 
strength  of  the  credentials  of  the  faculty  varied.  The  GAO  found 
that,  while  members  of  the  academy  faculties  periodically  have 
assessed  the  operations  of  their  respective  schools,  the  assess¬ 
ments  have  not  been  made  against  established  criteria — and  the 
intervals  between  assessments  vary  from  1  to  5  years. 

The  GAO  reported  that,  as  post-secondary  institutions,  the 
preparatory  schools  are  not  required  to  be  accredited  and  the 
standards  that  accrediting  agencies  require  of  schools  may  not  be 
appropriate  for  such  schools.  The  GAO  found  that  only  29  percent 
of  the  faculty  at  the  Army  preparatory  school  were  military 
personnel,  compared  with  100  percent  of  the  Air  Force  preparatory 
school  faculty  and  0  percent  of  the  Navy  preparatory  school 
faculty.  The  GAO  noted  that  accrediting  agencies  have  concerns 
about  the  instability  and  lack  of  teaching  experience  that 
results  from  frequent  turnover  of  military  faculty  at  the  acade¬ 
mies  .  The  GAO  found  that  the  faculty  at  the  Army  preparatory 
school  (1)  had  more  teaching  experience,  (2)  held  more  advanced 
degrees,  and  (3)  had  a  higher  percentage  of  certified  teachers 
than  the  faculty  at  the  other  two  schools. 

The  GAO  learned  that  the  Air  Force  conducts  an  annual  review  of 
its  preparatory  school;  the  Naval  Academy  only  conducts  a  review 
once  every  3  years;  while  the  Military  Academy  conducted  its 
first  review  in  1986  and  does  not  plan  to  conduct  a  follow-up 
review  until  5  years  later.  The  GAO  found  that  the  reviews 
reflect  an  informed  judgment  about  the  quality  of  the  preparatory 
school  programs,  but  do  not  measure  the  schools  against  a  uniform 
set  of  quality  standards .  The  GAO  also  observed  that  the  academy 
faculty  assessments  are  the  only  assessments  to  which  the  schools 
are  subject .  The  GAO  found  that  the  preparatory  schools  have  not 
received  any  independent  reviews  or  evaluation  by  the  DoD  or 
educational  accreditation  agencies.  The  GAO  concluded  that  the 
DoD  lacks  information  on  the  quality  of  the  preparatory  school 
programs , 

DoD  Response:  Concur.  Although  we  agree  that  standardized 
qualitative  evaluation  of  the  preparatory  schools  is  appropriate, 
we  do  not  support  formal  accreditation,  as  these  are  not  degree¬ 
granting  institutions.  We  also  support  the  Services  needs  to 
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Nowon  pp.  18-27. 


tailor  specific  areas  of  preparatory  school  mission  statements  to 
meet  Service-unique  requirements. 

•  FINDING  C:  The  DoD  Presently  Cannot  Evaluate  the  Preparatory 

Schools .  The  GAO  observed  that  the  DoD  had  not  established  the 
criteria  it  needs  to  evaluate  the  preparatory  schools .  The  GAO 
found  that  the  DoD  had  no  established  goals  whether  in  terms  of 
the  percentage  of  students  who  receive  an  academy  appointment  or 
the  numbers  graduating  from  the  academy.  The  GAO  also  found  that 
the  Services  have  not  established  specific  performance  targets 
the  schools  are  expected  to  meet. 

In  addition,  the  GAO  found  that  the  academic  performance  of 
preparatory  school  students  at  the  academies  generally  was  weaker 
than  that  of  other  cadets  and  midshipmen.  The  GAO  concluded, 
however,  that  the  academies  have  done  little  analysis  of  how  the 
preparatory  schools  affect  academy  performance.  The  GAO  noted 
that  a  1985  study  by  the  Military  Academy  found  preparatory 
school  students  entering  the  Academy  performed  as  expected,  based 
on  their  records  before  attending  the  school.  The  GAO  reported 
that  the  study  determined  the  effect  of  preparatory  school 
academic  training  was  minimal.  The  GAO  also  reported  that 
academy  graduation  rates,  both  for  cadets  and  midshipmen  admitted 
directly  to  the  academies  and  for  preparatory  school  students, 
varied  from  academy  to  academy.  The  GAO  found  that,  although  the 
Services  had  done  little  analysis  of  preparatory  school  student 
performance  as  officers,  the  data  available  indicated  that  their 
experience  is  similar  to  that  of  other  academy  graduates.  In 
summary,  the  GAO  concluded  that  the  DoD  lacks  the  tools  it  needs 
to  determine  whether  the  schools  are  effective.  (pp.  23-28/GAO 
Draft  Report) 

DoD  Response:  Concur.  The  Department  has  initiated  contact 

with  the  American  Council  on  Education  to  determine  avenues 
through  which  preparatory  school  academic  quality  may  be  evalu¬ 
ated. 

♦  FINDING  D:  Good  Data  on  Preparatory  School  Operating  Costs  Are 

Not  Available.  The  GAO  reported  that  the  DoD  had  only  limited 
information  on  the  cost  of  operating  the  preparatory  schools. 
The  GAO  found  that,  while  the  DoD  had  long  required  the  academies 
to  report  their  cost-per-graduate,  it  had  not  imposed  a  similar 
requirement  on  the  preparatory  schools.  The  GAO  observed  the 
Military  Service  estimates  of  preparatory  school  costs  indicate 
that,  for  FY  1990,  the  cost  for  all  preparatory  schools  totaled 
$24.9  million.  The  GAO  explained,  however,  that  determining  the 
cost  of  operating  the  preparatory  schools  presents  some  difficul¬ 
ties,  because  the  pay  and  benefits  for  military  personnel  and  the 
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cost  of  certain  support  services,  such  as  property  maintenance, 
utilities,  and  food  service,  are  not  charged  to  the  school 
operating  budgets,  and  must  be  estimated.  The  GAO  also  found 
that  the  three  Services  take  different  approaches  to  estimating 
operating  costs. 

The  GAO  reported  that  it  did  not  develop  a  complete  estimate  of 
the  cost  of  operating  schools,  but  found  that  the  Service  esti¬ 
mates  did  not  include  about  $2.9  million  in  costs.  The  GAO  found 
that  the  Navy  preparatory  school  cost  per  placement  was  the 
lowest  at  about  $39,000,  followed  by  the  Air  Force  preparatory 
school  at  about  $50,900,  and  the  Army  preparatory  school  at  about 
$60,900.  The  GAO  reported  that,  in  comparison,  the  annual  cost 
per  student  for  the  Service  Academies  was  about  $39,000  at  the 
Naval  Academy,  $52,900  at  the  Air  Force  Academy,  and  $56,900  at 
the  Military  Academy.  The  GAO  also  noted,  by  way  of  comparison, 
that  the  cost  of  tuition,  fees,  room,  and  board  for  attending  one 
of  27  highly  selective  colleges  that  offer  a  general  engineering 
degree  was  about  $15,800  in  1990.  The  GAO  observed  that,  while 
the  fees  colleges  charge  may  not  represent  the  true  costs  of 
providing  education,  the  education  cost  of  preparatory  schools 
reported  far  exceeded  the  average  charges  of  those  schools, 
(pp.  28-33/GAO  Draft  Report) 

DoD  Response:  Partially  concur.  The  costs  cited  by  the  GAO  for 
operating  academy  preparatory  schools  are  not  a  useful  means  of 
comparing  such  costs  with  private  institutions.  Total  public 
costs  per  year  at  a  private  institution  are  closer  to  the  total 
DoD  costs  of  preparatory  school  operation  than  the  annual  tuition 
costs  cited  by  the  GAO.  The  Department  developed  an  instruction 
for  standardized  cost  reporting  for  both  Service  academies  and 
the  preparatory  schools. 


FINDING  E:  Potential  for  Reducing  Costs  Related  to  Preparatory 
Schools  Is  Difficult  to  Assess.  The  GAO  reported  that  the  DoD 
recently  expressed  concern  about  the  cost  of  operating  the 
preparatory  schools.  The  GAO  found  that  a  DoD  task  force  recom¬ 
mended  the  three  Service  preparatory  schools  be  consolidated, 
noting  that  significant  savings  would  result.  The  GAO  reported 
that,  while  the  recommendation  was  not  adopted,  the  Military 
Services  were  directed  to  develop  plans  to  reduce  the  costs  of 
operating  their  preparatory  schools.  The  GAO  found,  however, 
that  the  potential  for  near-term  cost  reduction  is  difficult  to 
assess  because  some  costs  will  not  change  in  the  short  run, 
regardless  of  what  actions  are  taken  concerning  the  school.  The 
GAO  also  reported  that  the  incomplete  and  inconsistent  cost  data 
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available  on  the  preparatory  schools  limit  the  DoD  ability  to 
oversee  their  cost  effectively.  (pp.  33-36/GAO  Draft  Report) 

DoD  Response:  Concur.  The  Department  is  evaluating  a  number  of 
actions,  including  possible  consolidation  of  the  preparatory 
schools,  for  long-term  savings. 

***** 

RECCMffiNDATIONS 

Now  on  p.  29. 

•  recommendation  1:  The  GAO  recommended  that  the  Secretary  of 

Defense  (1)  determine  what  role  the  preparatory  schools  should 
play  among  the  Service  officer  production  programs  and  (2) 
direct  the  Services  to  clarity  their  school  missions  accord¬ 
ingly.  (p.  37 /GAO  Draft  Report) 

DoD  Response:  Concur.  The  Department  will  work  with  the  Ser- 
vices  to  develop  a  consistent  mission  statement  for  these 
schools.  The  mission  statement  will  be  approved  by  May  1992. 

Now  on  p.  29, 

•  RECOMMENDATION  2:  The  GAO  recommended  that  the  Secretary  of 

Defense  (1)  consult  with  recognized  authorities  on  educational 
quality  to  determine  what  standards  would  be  appropriate  to 
apply  to  the  preparatory  schools  in  terms  of  faculty  and  curric¬ 
ulum  and  (2)  require  periodic  reviews  by  qualified  independent 
parties  to  assure  that  the  preparatory  schools  meet  those  stan¬ 
dards.  (p.  37/GAO  Draft  Report) 

DoD  Response:  Concur.  The  Department  has  contacted  the  American 

Council  on  Education  for  assistance  in  identifying  appropriate 
authorities  for  evaluation  of  academic  quality.  An  independent 
evaluation  of  curricula  and  faculty  qualifications  at  the  prepa¬ 
ratory  schools  will  begin  in  the  1992-1993  academic  year. 

Now  on  p.  29. 

•  recommendation  3:  The  GAO  recommended  that  the  Secretary  of 

Defense  establish  standardized  guidelines  for  the  Services  to 
use  in  estimating  preparatory  school  costs.  (p.  37/GAO  Draft 

Report) 

DoD  Response:  Concur.  The  Department  has  developed  an  instruc- 
tion  for  reporting  standardized  Service  academy  costs,  and  expect 
publication  by  spring  of  1992.  This  instruction  addresses  all 
budgeted  and  programmed  costs  of  operation  of  Service  academy  and 
preparatory  schools.  The  instruction  will  be  implemented  begin¬ 
ning  with  the  1992-1993  academic  year. 
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•  RECOMMENDATION  4:  The  GAO  recommended  that,  once  performance 

standards  and  cost  estimating  guidelines  are  in  place,  the 
Secretary  of  Defense  require  periodic  analysis  of  the  cost-ef¬ 
fectiveness  of  continuing  to  operate  the  preparatory  schools. 

Now  on  p.  29.  (p.  37/GAO  Draft  Report) 

DoD  Response:  Concur.  Cost  effectiveness  will  be  evaluated 

annually,  as  a  provision  of  the  new  DoD  instruction,  which  will 
be  implemented  during  the  1992-1993  academic  year.  An  assessment 
of  the  quality  of  instruction  and  faculty  will  be  performed 
during  the  1992-1993  academic  year. 


•  RECOMMENDATION  5:  The  GAO  recommended  that  the  Secretary  of 

Defense  give  consideration  to  alternative  methods  of  providing 
academy  preparation,  such  as  utilizing  existing  educational 
institutions  or  the  private  sector,  given  the  relatively  high 
cost  per  cadet /midshipmen  placed  at  the  academies.  (P .  37/GAO 
Now  on  p.  29.  Draft  Report) 

DoD  Response:  Partially  concur.  The  Department  recognizes  the 
potential  relative  savings  of  DoD  funds  through  use  of  alterna¬ 
tive  programs.  However,  preparatory  school  programs  are  tailored 
and  focused  for  enabling  students  to  succeed  at  the  academies,  in 
both  academic  and  military  aspects  of  the  programs.  Neverthe¬ 
less,  the  merits  of  alternative  programs  will  be  examined.  That 
review  will  be  completed  by  the  end  of  the  1992-1993  academic 
year  {June  1993) . 
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The  following  is  GAO’s  comment  on  the  Department  of  Defense’s  letter 
dated  February  24, 1992. 


GAO  Comment 


1.  According  to  the  data  that  the  Military  Academy  provided  to  us,  a  total  of 
1 70  enUsted  personnel  entered  the  Academy  in  the  classes  of  1993  and 
1994,  and  all  170  came  from  the  prep  school.  We  did  not  verify  that  data. 
We  changed  the  narrative  to  avoid  implying  that  the  prep  school  is  the  sole 
source  of  enUsted  input  into  the  Academy. 
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